***********************************************************
Mountain Car using Ordinary Bellman Equation
***********************************************************

Options used when running:

0: Mountain car
100: Order --- this means we will have 100^2 = 10,000 weights to tune
1: No value averaging
0: Ordinary Bellman
300: Number of interations of value iteration
16: Number of threads used by value iteration (set to your number of cores)
16: Number of threads used to evaluate a policy (set to your number of cores)
1: Evaluate policy after every iteration
0: Print results to file
out_Ordinary_MountainCar.txt: The file to print the results to

Console output:

Select environment:
[0] Mountain Car
[1] Puddle World
[2] Acrobot
[3] Cart Pole
[4] Pendulum Swing-Up and Balance
[5] Bicycle
Selection: 0
Enter the order (state is 2 dimensional): 100
Select value averaging:
[0] Yes
[1] No
Selection: 1
Select maxQ Variant:
[0] Ordinary Bellman
[1] Consistent Bellman
Selection: 0
Enter number of iterations of value iteration: 300
Enter number of threads for value-iteration (we suggest # available cores): 16
Enter number of threads for policy evaluation (we suggest # available cores): 16
Evaluate policy every how-many iterations? 1
Select Print results to file:
[0] Yes
[1] No
Selection: 0
Enter filename: out_Ordinary_MountainCar.txt

Initially: Timesteps in episode = 1000
Iteration: 1	Timesteps in episode = 1000
Iteration: 2	Timesteps in episode = 1000
Iteration: 3	Timesteps in episode = 1000
Iteration: 4	Timesteps in episode = 1000
Iteration: 5	Timesteps in episode = 1000
Iteration: 6	Timesteps in episode = 1000
Iteration: 7	Timesteps in episode = 1000
Iteration: 8	Timesteps in episode = 1000
Iteration: 9	Timesteps in episode = 1000
Iteration: 10	Timesteps in episode = 1000
Iteration: 11	Timesteps in episode = 1000
Iteration: 12	Timesteps in episode = 1000
Iteration: 13	Timesteps in episode = 1000
Iteration: 14	Timesteps in episode = 1000
Iteration: 15	Timesteps in episode = 1000
Iteration: 16	Timesteps in episode = 1000
Iteration: 17	Timesteps in episode = 1000
Iteration: 18	Timesteps in episode = 1000
Iteration: 19	Timesteps in episode = 1000
Iteration: 20	Timesteps in episode = 1000
Iteration: 21	Timesteps in episode = 1000
Iteration: 22	Timesteps in episode = 1000
Iteration: 23	Timesteps in episode = 1000
Iteration: 24	Timesteps in episode = 1000
Iteration: 25	Timesteps in episode = 1000
Iteration: 26	Timesteps in episode = 1000
Iteration: 27	Timesteps in episode = 1000
Iteration: 28	Timesteps in episode = 1000
Iteration: 29	Timesteps in episode = 1000
Iteration: 30	Timesteps in episode = 1000
Iteration: 31	Timesteps in episode = 1000
Iteration: 32	Timesteps in episode = 373
Iteration: 33	Timesteps in episode = 1000
Iteration: 34	Timesteps in episode = 1000
Iteration: 35	Timesteps in episode = 297
Iteration: 36	Timesteps in episode = 190
Iteration: 37	Timesteps in episode = 159
Iteration: 38	Timesteps in episode = 179
Iteration: 39	Timesteps in episode = 151
Iteration: 40	Timesteps in episode = 1000
Iteration: 41	Timesteps in episode = 153
Iteration: 42	Timesteps in episode = 160
Iteration: 43	Timesteps in episode = 141
Iteration: 44	Timesteps in episode = 157
Iteration: 45	Timesteps in episode = 243
Iteration: 46	Timesteps in episode = 157
Iteration: 47	Timesteps in episode = 141
Iteration: 48	Timesteps in episode = 144
Iteration: 49	Timesteps in episode = 145
Iteration: 50	Timesteps in episode = 192
Iteration: 51	Timesteps in episode = 163
Iteration: 52	Timesteps in episode = 164
Iteration: 53	Timesteps in episode = 161
Iteration: 54	Timesteps in episode = 160
Iteration: 55	Timesteps in episode = 160
Iteration: 56	Timesteps in episode = 160
Iteration: 57	Timesteps in episode = 163
Iteration: 58	Timesteps in episode = 162
Iteration: 59	Timesteps in episode = 164
Iteration: 60	Timesteps in episode = 162
Iteration: 61	Timesteps in episode = 165
Iteration: 62	Timesteps in episode = 165
Iteration: 63	Timesteps in episode = 165
Iteration: 64	Timesteps in episode = 164
Iteration: 65	Timesteps in episode = 163
Iteration: 66	Timesteps in episode = 163
Iteration: 67	Timesteps in episode = 163
Iteration: 68	Timesteps in episode = 163
Iteration: 69	Timesteps in episode = 163
Iteration: 70	Timesteps in episode = 163
Iteration: 71	Timesteps in episode = 162
Iteration: 72	Timesteps in episode = 161
Iteration: 73	Timesteps in episode = 160
Iteration: 74	Timesteps in episode = 159
Iteration: 75	Timesteps in episode = 158
Iteration: 76	Timesteps in episode = 158
Iteration: 77	Timesteps in episode = 156
Iteration: 78	Timesteps in episode = 156
Iteration: 79	Timesteps in episode = 156
Iteration: 80	Timesteps in episode = 155
Iteration: 81	Timesteps in episode = 155
Iteration: 82	Timesteps in episode = 154
Iteration: 83	Timesteps in episode = 154
Iteration: 84	Timesteps in episode = 154
Iteration: 85	Timesteps in episode = 154
Iteration: 86	Timesteps in episode = 154
Iteration: 87	Timesteps in episode = 154
Iteration: 88	Timesteps in episode = 153
Iteration: 89	Timesteps in episode = 153
Iteration: 90	Timesteps in episode = 153
Iteration: 91	Timesteps in episode = 153
Iteration: 92	Timesteps in episode = 153
Iteration: 93	Timesteps in episode = 153
Iteration: 94	Timesteps in episode = 153
Iteration: 95	Timesteps in episode = 153
Iteration: 96	Timesteps in episode = 153
Iteration: 97	Timesteps in episode = 153
Iteration: 98	Timesteps in episode = 153
Iteration: 99	Timesteps in episode = 153
Iteration: 100	Timesteps in episode = 153
Iteration: 101	Timesteps in episode = 153
Iteration: 102	Timesteps in episode = 153
Iteration: 103	Timesteps in episode = 153
Iteration: 104	Timesteps in episode = 153
Iteration: 105	Timesteps in episode = 153
Iteration: 106	Timesteps in episode = 153
Iteration: 107	Timesteps in episode = 147
Iteration: 108	Timesteps in episode = 147
Iteration: 109	Timesteps in episode = 147
Iteration: 110	Timesteps in episode = 103
Iteration: 111	Timesteps in episode = 103
Iteration: 112	Timesteps in episode = 103
Iteration: 113	Timesteps in episode = 103
Iteration: 114	Timesteps in episode = 103
Iteration: 115	Timesteps in episode = 103
Iteration: 116	Timesteps in episode = 103
Iteration: 117	Timesteps in episode = 103
Iteration: 118	Timesteps in episode = 103
Iteration: 119	Timesteps in episode = 103
Iteration: 120	Timesteps in episode = 103
Iteration: 121	Timesteps in episode = 103
Iteration: 122	Timesteps in episode = 103
Iteration: 123	Timesteps in episode = 103
Iteration: 124	Timesteps in episode = 103
Iteration: 125	Timesteps in episode = 103
Iteration: 126	Timesteps in episode = 103
Iteration: 127	Timesteps in episode = 103
Iteration: 128	Timesteps in episode = 103
Iteration: 129	Timesteps in episode = 103
Iteration: 130	Timesteps in episode = 103
Iteration: 131	Timesteps in episode = 103
Iteration: 132	Timesteps in episode = 103
Iteration: 133	Timesteps in episode = 103
Iteration: 134	Timesteps in episode = 103
Iteration: 135	Timesteps in episode = 103
Iteration: 136	Timesteps in episode = 103
Iteration: 137	Timesteps in episode = 103
Iteration: 138	Timesteps in episode = 103
Iteration: 139	Timesteps in episode = 103
Iteration: 140	Timesteps in episode = 103
Iteration: 141	Timesteps in episode = 103
Iteration: 142	Timesteps in episode = 103
Iteration: 143	Timesteps in episode = 103
Iteration: 144	Timesteps in episode = 103
Iteration: 145	Timesteps in episode = 103
Iteration: 146	Timesteps in episode = 103
Iteration: 147	Timesteps in episode = 103
Iteration: 148	Timesteps in episode = 103
Iteration: 149	Timesteps in episode = 103
Iteration: 150	Timesteps in episode = 103
Iteration: 151	Timesteps in episode = 103
Iteration: 152	Timesteps in episode = 103
Iteration: 153	Timesteps in episode = 103
Iteration: 154	Timesteps in episode = 103
Iteration: 155	Timesteps in episode = 103
Iteration: 156	Timesteps in episode = 103
Iteration: 157	Timesteps in episode = 103
Iteration: 158	Timesteps in episode = 103
Iteration: 159	Timesteps in episode = 103
Iteration: 160	Timesteps in episode = 103
Iteration: 161	Timesteps in episode = 103
Iteration: 162	Timesteps in episode = 103
Iteration: 163	Timesteps in episode = 103
Iteration: 164	Timesteps in episode = 103
Iteration: 165	Timesteps in episode = 103
Iteration: 166	Timesteps in episode = 103
Iteration: 167	Timesteps in episode = 103
Iteration: 168	Timesteps in episode = 103
Iteration: 169	Timesteps in episode = 103
Iteration: 170	Timesteps in episode = 103
Iteration: 171	Timesteps in episode = 103
Iteration: 172	Timesteps in episode = 103
Iteration: 173	Timesteps in episode = 103
Iteration: 174	Timesteps in episode = 103
Iteration: 175	Timesteps in episode = 103
Iteration: 176	Timesteps in episode = 103
Iteration: 177	Timesteps in episode = 103
Iteration: 178	Timesteps in episode = 103
Iteration: 179	Timesteps in episode = 103
Iteration: 180	Timesteps in episode = 103
Iteration: 181	Timesteps in episode = 103
Iteration: 182	Timesteps in episode = 103
Iteration: 183	Timesteps in episode = 103
Iteration: 184	Timesteps in episode = 103
Iteration: 185	Timesteps in episode = 103
Iteration: 186	Timesteps in episode = 103
Iteration: 187	Timesteps in episode = 103
Iteration: 188	Timesteps in episode = 103
Iteration: 189	Timesteps in episode = 103
Iteration: 190	Timesteps in episode = 103
Iteration: 191	Timesteps in episode = 103
Iteration: 192	Timesteps in episode = 103
Iteration: 193	Timesteps in episode = 103
Iteration: 194	Timesteps in episode = 103
Iteration: 195	Timesteps in episode = 103
Iteration: 196	Timesteps in episode = 103
Iteration: 197	Timesteps in episode = 103
Iteration: 198	Timesteps in episode = 103
Iteration: 199	Timesteps in episode = 103
Iteration: 200	Timesteps in episode = 103
Iteration: 201	Timesteps in episode = 103
Iteration: 202	Timesteps in episode = 103
Iteration: 203	Timesteps in episode = 103
Iteration: 204	Timesteps in episode = 103
Iteration: 205	Timesteps in episode = 103
Iteration: 206	Timesteps in episode = 103
Iteration: 207	Timesteps in episode = 103
Iteration: 208	Timesteps in episode = 103
Iteration: 209	Timesteps in episode = 103
Iteration: 210	Timesteps in episode = 103
Iteration: 211	Timesteps in episode = 103
Iteration: 212	Timesteps in episode = 103
Iteration: 213	Timesteps in episode = 103
Iteration: 214	Timesteps in episode = 103
Iteration: 215	Timesteps in episode = 103
Iteration: 216	Timesteps in episode = 103
Iteration: 217	Timesteps in episode = 103
Iteration: 218	Timesteps in episode = 103
Iteration: 219	Timesteps in episode = 103
Iteration: 220	Timesteps in episode = 103
Iteration: 221	Timesteps in episode = 103
Iteration: 222	Timesteps in episode = 103
Iteration: 223	Timesteps in episode = 103
Iteration: 224	Timesteps in episode = 103
Iteration: 225	Timesteps in episode = 103
Iteration: 226	Timesteps in episode = 103
Iteration: 227	Timesteps in episode = 103
Iteration: 228	Timesteps in episode = 103
Iteration: 229	Timesteps in episode = 103
Iteration: 230	Timesteps in episode = 103
Iteration: 231	Timesteps in episode = 103
Iteration: 232	Timesteps in episode = 103
Iteration: 233	Timesteps in episode = 103
Iteration: 234	Timesteps in episode = 103
Iteration: 235	Timesteps in episode = 103
Iteration: 236	Timesteps in episode = 103
Iteration: 237	Timesteps in episode = 103
Iteration: 238	Timesteps in episode = 103
Iteration: 239	Timesteps in episode = 103
Iteration: 240	Timesteps in episode = 103
Iteration: 241	Timesteps in episode = 103
Iteration: 242	Timesteps in episode = 103
Iteration: 243	Timesteps in episode = 103
Iteration: 244	Timesteps in episode = 103
Iteration: 245	Timesteps in episode = 103
Iteration: 246	Timesteps in episode = 103
Iteration: 247	Timesteps in episode = 103
Iteration: 248	Timesteps in episode = 103
Iteration: 249	Timesteps in episode = 103
Iteration: 250	Timesteps in episode = 103
Iteration: 251	Timesteps in episode = 103
Iteration: 252	Timesteps in episode = 103
Iteration: 253	Timesteps in episode = 103
Iteration: 254	Timesteps in episode = 103
Iteration: 255	Timesteps in episode = 103
Iteration: 256	Timesteps in episode = 103
Iteration: 257	Timesteps in episode = 103
Iteration: 258	Timesteps in episode = 103
Iteration: 259	Timesteps in episode = 103
Iteration: 260	Timesteps in episode = 103
Iteration: 261	Timesteps in episode = 103
Iteration: 262	Timesteps in episode = 103
Iteration: 263	Timesteps in episode = 103
Iteration: 264	Timesteps in episode = 103
Iteration: 265	Timesteps in episode = 103
Iteration: 266	Timesteps in episode = 103
Iteration: 267	Timesteps in episode = 103
Iteration: 268	Timesteps in episode = 103
Iteration: 269	Timesteps in episode = 103
Iteration: 270	Timesteps in episode = 103
Iteration: 271	Timesteps in episode = 103
Iteration: 272	Timesteps in episode = 103
Iteration: 273	Timesteps in episode = 103
Iteration: 274	Timesteps in episode = 103
Iteration: 275	Timesteps in episode = 103
Iteration: 276	Timesteps in episode = 103
Iteration: 277	Timesteps in episode = 103
Iteration: 278	Timesteps in episode = 103
Iteration: 279	Timesteps in episode = 103
Iteration: 280	Timesteps in episode = 103
Iteration: 281	Timesteps in episode = 103
Iteration: 282	Timesteps in episode = 103
Iteration: 283	Timesteps in episode = 103
Iteration: 284	Timesteps in episode = 103
Iteration: 285	Timesteps in episode = 103
Iteration: 286	Timesteps in episode = 103
Iteration: 287	Timesteps in episode = 103
Iteration: 288	Timesteps in episode = 103
Iteration: 289	Timesteps in episode = 103
Iteration: 290	Timesteps in episode = 103
Iteration: 291	Timesteps in episode = 103
Iteration: 292	Timesteps in episode = 103
Iteration: 293	Timesteps in episode = 103
Iteration: 294	Timesteps in episode = 103
Iteration: 295	Timesteps in episode = 103
Iteration: 296	Timesteps in episode = 103
Iteration: 297	Timesteps in episode = 103
Iteration: 298	Timesteps in episode = 103
Iteration: 299	Timesteps in episode = 103
Iteration: 300	Timesteps in episode = 103
Printing results to out_Ordinary_MountainCar.txt

